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(54) Channel estimation using a probability mapping table 



(57) The invention relates to an estimation appara- 
tus of a receiving device for estimating the transmission 
operation of a transmission channel, in which case the 
transmission channel is subject to interference, and in 
which the analogue data (5) received from the transmis- 
sion channel is assigned an estimator sequence (a) of 



digital data values, in which the estimator apparatus pro- 
duces at least one estimation sequence (a), in which 
both characteristics of the transmission channel and 
characteristics of the receiver are included, in order in 
this way to improve the reception characteristics in gen- 
eral and, in particular, the bit error rate of the estimation 
sequence (a). 
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Description 

[0001] The invention relates to an estimation apparatus for estimating the transmission operation of a transmission 
channel for digital data, in which case the transmission channel is or may be subject to interference, and to a receiver 

5 and a system for transmitting data using such an estimation apparatus. 

[0002] Optical long-distance communications systems with transmission rates of 10 Gbit/s or more and which use 
standard monomode optical fibres, erbium-doped fibre amplifiers and noncoherent optical receivers, are adversely 
affected by nonlinear pulse dispersion and signal-dependent non-Gaussian noise. If receiver circuits corresponding to 
the prior art are used here, losses occur with regard to the range, the data rate or the error rate. This is caused by the 

fo square-function characteristic of the optical/electrical transducer and a number of physical phenomena such as chro- 
matic dispersion, polarization-mode dispersion, the nonlinear Kerr effect, chirp, extinction ratio, self-phase modulation 
or noise resulting from spontaneous emission, see, for example, Agrawal, G.P. in Fiber-Optic Communication Systems. 
Second Edition, New York: John Wiley & Sons, Inc., 1997. 

[0003] The wide range of effects, some of which vary with time, leads on the one hand to the impossibility of producing 
f s a closed a priori description of the behaviour of the resultant electrical channel and of the resultant noise. On the other, 
this results in a nonlinear transmission channel which varies with time and is subject to memory and which has signal- 
dependent noise with an unknown likelihood density, which must be estimated while data transmission is taking place. 
[0004] In addition, problems occur in the provision of suitable receiver circuits for data rates of 10 Gbit/s or more. 
Furthermore, some digital devices operate in such a way that an analog/digital transducer (ADC) is required for these 
20 sampling frequencies. Such components are not prior art and at the moment can be produced only if very poor resolution 
is accepted, with further static and dynamic nonilinearities, that is to say non linearities which are dependent on previous 
samples. 

[0005] Since virtually distortion -free transmission can be assumed at data rates of less than 2.5 Gbit/s in optical long- 
distance systems, receiver circuits comprising a low-pass filter, automatic gain control and a threshold-value decision 
25 maker are regarded as prior art, by means of which the required bit error rate of less than 1 0* 12 is achieved. If the data 
rate on these optical paths is increased, then, however, such arrangements do not take account of the pulse dispersion 
effects described initially and which now occur. The error rate can then well exceed the permissible limit, depending 
on a large number of influences, as a result of which the connection will fail at times or entirely. Alternatively, error- 
correcting coding would have to be provided, with the usable data rate thus being reduced or the distance being short- 
so ened. 

[0006] Furthermore, approaches are known for compensating for some of the effects by means of optical equalizers, 
see Heismann, F. et al. in Automatic Compensation of First-Order Polarization Mode Dispersion in a 10 Gb/s Trans- 
mission System. Proc. of ECOC'98, pages 529-530, Madrid, 1 998. A first disadvantage is that the active optical com- 
ponents required to do this represent a considerable costfactor and, secondly, the signal-theory causes of the problems 
35 resulting from this can be only partially solved, and only in comparatively good conditions. The latter also applies to 
the adaptive electrical filter approach (linear feed forward equalizer). This is because, firstly, this generally increases 
the noise level and, secondly, it can remove distortion only from linear channels or, in some cases, slightly nonlinear 
channels. 

[0007] The structure of the decision feedback amplifier which is known from Kasturia, S., Winters, J.K in Techniques 
40 for High-Speed Implementation of Nonlinear Cancellation. IEEE Journal on Selected Areas in Communications, Vol. 
9, pages 711-717 : 1991, is also used for this purpose. This interference compensation principle is, however, funda- 
mentally lossy, and leads to error propagation. Furthermore, the achievable error rate is always dependent on the 
decision time within the bit interval. 

[0008] The theory behind the receiver for nonlinear channels with memory, which makes decisions on the basis of 
45 minimum error likelihood, is discussed in the literature, see Benedetto, S., Biglieri E., Castellani, V. in Digital Trans- 
mission Theory, New Jersey, Prentice-Hall, 1987. This solution approach relates to a probabilistic estimator for the 
transmitted bit sequence, which requires a priori knowledge of the signal forms of the nonlinear channel not subject to 
interference, as well as the conditional likelihoods of the interference. The above statements have shown, however, 
that neither is known. 

so [0009] With regard to analogue/digital transducers, known arrangements already exist which comprise a nonlinear 
instantaneous function, the ADC and a digital correction apparatus, see DE 44 09 063 C1 . Since these arrangements 
are used only to compensate for static effects (for example to increase the drive range), the reaction to dynamic changes 
of channel characteristics or interference is extremely unsatisfactory. Furthermore, such systems require a fast ADC 
which, as a result of the problems explained, leads to a further adverse effect on the resultant transmission channel. 

55 [0010] The invention is based on the object of reducing the problems described above and, in particular, of providing 
an improved estimation apparatus for estimating the transmission operation of a transmission channel for digital data 
which is subject to inference, as well as a receiver and a system for transmitting data using such an estimation appa- 
ratus. 
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[0011] This object is achieved by an estimation apparatus having the features of Claim 1 , by a receiver having the 
feature of Claim 12, and by a system for transmitting data having the features of Claim 14. 

[001 2] In a particularly advantageous manner, the estimation apparatus according to the invention is used to produce 
at least one estimation sequence which includes characteristics not only of the transmission channel but also of the 
5 conversion device, and this results in an improvement in the bit error rate of the overall transmission path comprising 
the transmission channel and the receiving device. 

[0013] It is furthermore advantageous to digital/analogue convert the analogue input signal and to assign a value 
set from a metrics table to the digital/analogue converted value since, in this case, random influences occurring on the 
transmission path can be taken into account using the values from the metrics table. 
w [001 4] Those effects of the transmission path which are subject to memory can, furthermore, be taken into account 
in a manner which is efficient in terms of computation, if the values of the metrics table in each case comprise the 
logarithm of the conditional likelihoods for the possible channel states, which results from a finite number of most 
recently transmitted symbols. 

[001 5] In one particularly preferred embodiment, the values in the metrics table become the conditional likelihoods, 
*5 which in each case cover the likelihood of the occurrence of a received value, subject to the condition that the channel 
is in a specific state, and with this conditional likelihood being obtained by counting the received subsequent values 
from the estimation sequence of estimated channel states. 

[001 6] In one advantageous embodiment, a state in each case corresponds to a digital interval of the digital/analogue 
transducer, and an element in the metrics table corresponds to the logarithm of the conditional likelihood. In conse- 
nt* quence, multiplication operations of likelihoods, which are advantageous in terms of data processing, can be expressed 
as the addition of their metrics values. 

[0017] Major advantages result if the conditional likelihoods are obtained by counting the events in that a received 
value occurs when the channel is in a state which is obtained from the estimation sequence (a) since, in this case, 
even a simple memory module can store these values as matrix elements or, in processed form, as elements in a 
25 metrics table. Furthermore, if, after completion of a measurement interval, the likelihood is normalized by forming the 
ratio with the total number of received values which have occurred for each channel state, the pure numerical values 
obtained in this way themselves represent the respective conditional likelihoods. 

[0018] Dynamic adaptation is advantageously made possible by the elements in the metrics table being updated on 
the basis of the received value sequences. 
30 [0019] This concept can be advantageously implemented by means of a data estimator to which the associated 
value set from the metrics table is supplied and which in each case assigns a most likely value of an estimation sequence 
to the supplied value set and supplies an output signal to a discrete channel estimator which signal describes the 
estimated channel state. 

[0020] In this case, the output signals can advantageously be used for continuous calculation of the metrics table 
35 values in the discrete channel estimator, on the basis of histogram values of the conditional likelihoods. 

[0021] If the time correlations of those elements of interference or nonlinear effects which are subject to memory act 
for a longer time than the duration of only one transmitted symbol, the metrics table values may each be associated 
with more than one previous state change, in this case resulting in corresponding multiplication of the matrix elements 
of the numerical values and of the elements in the metrics table. In this context, reference is also made to the article 
40 by A. Kavcic, J. Moura, The Viterbi Algorithm and Markov Noise Memory, IEEE Trans. Information Theory, Vol. 46, No. 
1 , Jan. 2000 pp. 291-300 whose contents are incorporated completely here by reference. 

[0022] The invention will be described in more detail in the following text using the attached drawings and with ref- 
erence to preferred embodiments. 



45 Brief description of the figures 
[0023] 



Figure 1 shows a typical optical transmission path in which the invention can be used, 

so Figure 2 shows an eye diagram of a signal received from an optical transmission path essentially without 

any interference, in particular the transmission path shown in Figure 1, 

Figures 3a and b show the comparison of the electrical implementation of a conventional detector and of the re- 
ceiver structure according to the invention, 

Figure 4 shows the quantization characteristic of a quantizer, in particular of an analogue/digital trans- 

55 ducer(ADC), 

Figure 5 shows a block diagram of the assemblies of the receiver structure from Figure 3b, 

Figure 6 shows the transition from numerical values of the respective conditional likelihoods for a quan- 

tized or, in particular, digital value for an estimated channel state to metrics values which indicate, 
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Figure 7 



in particular, the logarithm of the respective conditional likelihood, 

shows the relationship between the likelihood density function and the likelihood distribution of 
the quantized or digitized signal. 



5 Detailed description of preferred embodiments 

[0024] In the simplest case, an optical transmission system comprises three basic units (illustrated by way of example 
in Figure 1), a transmitter 1 , a transmission medium 2 and a receiver 3. A semiconductor laser whose light intensity is 
modulated with an electrical signal is preferably used for the transmitter 1 . 
10 [0025] Various types of optical fibre may be used as the transmission medium 2, in particular such as monomode 
fibres, gradient fibres and the like, which allow propagation guided in the form of waveguides for the electromagnetic 
waves. Commercial systems normally use photodiodes for detection of the optical signals, and these supply a current 
which is largely proportional to the optical power. 

[0026] The task of subsequent detectors is, in general, to reconstruct the original digital data stream 4 with as few 
*5 errors as possible from the electrical signal 5. 

[0027] By way of example, Figure 2 shows the electrical received signals 5, in each case shifted by an integer multiple 
of a bit interval T and superimposed, of a typical optical transmission path (eye diagram). 

[0028] In conventional systems, the electrical signal 5 is sampled at equidistant intervals, corresponding to one bit 
interval, and is supplied to a simple threshold-value decision maker 6, illustrated by way of example in Figure 3a. A 
20 "1 11 or a "0" is detected as part of a signal sequence a depending on whether the signal is above or below the decision 
threshold at the sampling time. 

[0029] The invention is based on the new receiver structure described in the following text and illustrated by way of 
example in Figure 3b. 

[0030] While conventional detectors, as illustrated in Figure 3a, essentially comprise only a low-pass filter 7 and a 
25 threshold-value decision maker 6, together with a device for samples 8 taken at discrete times, the estimation apparatus 
9 according to the invention provides a receiver structure with time quantization by means of the sampler 8 and value 
quantization by means of a quantizer 10, in particular an A/D transducer 10 and a downstream data estimation appa- 
ratus 1 1 . 

[0031] The electrically preprocessed signal 5 received by the photodiode 3 is supplied to a filter 1 2 and is sampled 
30 by the sampler 8 in time with the symbols. The continuous analogue signal downstream from the filter 1 2 is converted 
into a digital signal by means of the analogue/digital transducer 10. The output of the A/D transducer 10 supplies the 
data estimation apparatus 1 1 with a discrete value from a set of a finite number of quantized or digitized values, which 
are associated with the occurrence-of a specific event, for example as the event 1 : "the sampled value is between 
threshold 4' and 5". 

35 [0032] The estimation apparatus according to the invention now tries to reconstruct the transmitted bit sequence 4 
as well as possible from the sampled and quantized values. 

[0033] This object has been achieved by inventing an estimation apparatus which also includes an estimation device 
for channel estimation 13, see for example Figure 5, which, on the basis of information arriving from the A/D transducer 
10, adaptively adjusts itself to any desired nonlinear channels, non-Gaussian interference and the natural character- 
40 istics of the A/D transducer 10 or other imperfections, and compensates for or corrects them as far as possible, and, 
in particular in conjunction with the estimated channel, carries out an estimation of the transmitted bit sequence 4 in 
such a manner that the error likelihood in the estimation sequence a is as small as possible. 

[0034] The invention thus covers two of the previously mentioned problem areas: firstly, static nonlinearities and 
dynamic nonlinearities which are dependent on the bit sequence from the A/D transducer 10 are taken into account 
45 and thus compensated for Secondly, both the resultant conditional inference likelihood densities, which are dependent 
on the bit sequence, and the nonlinear channel model for the probabilistic sequence estimator, are estimated including 
any required unique characteristic, which is necessarily known, of the A/D transducer while data transmission is taking 
place. 

[0035] Based on the simple model of a quantizer which, in this case, is also regarded as the most general form of a 
50 digitizer or A/D transducer, one important aspect of the present estimation apparatus will be explained in more detail 
in the following text. 

[0036] The quantizer provides a function which assigns elements in a finite set to the continuous, real input values. 
If r denotes the input value and ? denotes the output value of the quantizer, then 
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Equation 1 



Q : re K-»fi(r) = ?e 
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[0037] Each input value r G R has only one associated output value 

?€ {? a) , r a) 7 { »} 

5 

The definition range, which in this case covers the set of real numbers, is therefore subdivided into disjunctive intervals, 
and each interval is assigned an applicable function value r (i) . Normally, the number of intervals exactly corresponds 
to the power of the value set. The limits between the intervals are denoted as thresholds. 
w [0038] Figure 4 shows an example of a quantization function graphically, in the form of a characteristic. 

[0039] The actual estimation of the transmitted data sequence is based on an apparatus which estimates the state 
sequence of a channel modelled as an automatic system on the basis of theoretical likelihood considerations, and 
uses this to determine the most probably transmitted symbol sequence a. 

[0040] To do this, the data estimator 1 1 requires so-called metrics increments which are shown, by way of example, 
*5 in Figure 7 as elements"! " in a metrics table 1 4 and which are related to the conditional likelihood of a specific analogue/ 

digital converted value and of a channel state, and in consequence are related to the interference likelihood density. 

[0041] One aspect of the present invention is based on obtaining the required metric increments "1" on the basis of 

channel-state-dependent observation of the information supplied from the quantizer 10. To do this, the events are 

counted as a function of the states ! and the overall required statistical characteristics of the channel can be derived 
20 from this. The metrics increments are stored in a table 14, and the number of events is stored in a store 15, which is 

likewise shown byway of example in Figure 7. Table 1 4 for the metrics increments "1 0 is connected directly downstream 

from the A/D transducer 10, as can also be seen in Figure 5. 

[0042] The channel model used in US Patent 5, 131, 011 generates the possible channel output signals, as a function 
of the state, in the absence of noise, and the channel estimation method also adaptively determines the noise-free 
25 potential output signals. However, this method cannot be used for optimum consequence estimation for non-Gaussian, 
state-dependent noise. For this reason, the branch metrics Table 14 for the channel model of the invention contains 
the complete stochastic characteristics of the channel from the point of view of the assessment apparatus, which 
characteristics are determined adaptively. 

30 Theory of an optimum estimator (MLSE) for quantized signals 

[0043] The following text describes the theoretical principles of optimum estimation taking account of an A/D trans- 
ducer and this estimation forms the basis for the inventive solution to the problem of an optimum estimator. 
[0044] The quantizer or A/D transducer provides a function which assigns elements in a finite set to the continuous, 
35 real input values. If r denotes the input value of the quantizer and ? the output value, then reference is made to equation 
1 , in which case this functional definition includes the requirement for uniqueness, that is to say each input value r e 
R has only a single associated output value 

40 r € {r (1) , 

45 The definition range (in this case the set of real numbers) is thus subdivided into disjunctive intervals, and each interval 
is assigned an associated valid function value ? {i) • Normally, the number of intervals just corresponds to the power 
P of the value set. The limits between the intervals [Sj_1 , Sj] with which the values r <11 are associated, are referred to 
as thresholds. 

[0045] If r denotes the vector of the quantized samples, then, on the assumption that successive samples are 
so statistically independent, the expression for the maximum likelihood sequence estimator is: 
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Equation 2 



a - arg{max(/7(f|^))} 
b 



10 



[0046] Since the random variables r u can assume only a finite number of discrete values, the conditional likelihood 
density function consists of weighted delta pulses. The a priori likelihood P( ? u lb) of the occurrence of a specific output 
value from the quanitizer is therefore used instead of the density function . If it is also assumed that the value r^ sampled 
is at the discrete time depends only on the L previously transmitted symbols (finite memory), then: 



Equation 3 



20 



a = arg 



25 



= arg 



30 



= argj max| £ 



[0047] Since both the variable r „ and Z^can assume only a finite number of different values, the individual branch 
metrics or elements of the metrics Table 14 can store 1 ( ?u<,Z M ) in a table, which is highly conducive to the hardware 
35 implementation, since this Table 14 can be in the form of a store. 

[0048] A priori likelihood P(r J2y can easily be determined exactly from the a priori density function p( r w IZ M ) of the 
signal with continuous values. In this case: 



40 



45 



Equation 4 



- \p(r\z (k) )dr 



50 
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[0049] This means that the a priori likelihood for a specific event corresponds exactly to the area of the a priori 
likelihood density function between the two associated thresholds, as is shown in Figure 7, which explains the rela- 
tionship between the likelihood density function and the likelihood distribution of the quantized signal. 
[0050] In consequence, the variables P( ? JZ R ) required for the optimum estimator can, in a practical implementation, 
be obtained by measuring the relative frequency, which corresponds to the number of events related to the total number 
of measurements, with which the samples r^ lie in an interval S M <r^<Sj for a specific channel state Z< k >. However, the 
interval in which a sample lies is precisely the magnitude which a quantizer provides at its output The digital quantizer 
output can therefore be used as the address of a memory cell, which is incremented by one for the relevant sample 
and the relevant state, and thus contains the number of events. After completion of a measurement cycle, the frequency 
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distribution for each state ZW can be deduced from the total number of samples and the memory contents. Since 
likelihoods in logarithmic form are generally used for calculation purposes, the required branch metrics are obtained 
by taking logarithms of the frequency values. 

[0051] The metrics Table 14, which may also be referred to as a branch metrics table, thus contains those metric 
increments which can be used directly for a Viterbi algorithm (VA) in the data estimation apparatus 11 . The application 
of the Viterbi algorithm to the values in the metrics Table 14 is well known to persons skilled in the art, and does not 
require any further explanation at this point. 

[0052] Theoretically, it is also possible to verify that these metrics increments or elements in the metrics table are 
expediently the logarithms of the conditional likelihoods of the respective transitions 1(7.1 z^) =- logP(',| z^J. This 
Table 14 may be implemented by one or more random access memories, in which case the quantized signal then 
represents the respective address. 

Channel estimator 

[0053] The channel estimator 1 3 has the task of estimating the required conditional likelihoods. The channel estimator 
comprises a delay element for the quantized signal r „ , a shift register for determining the channel state, and a table 
for counting the events, and the latter is represented as Table 15 in Figure 6. This Table 15 may be implemented by 
one or more random access memories, in which case the quantized and delayed signal and the associated estimated 
state represent the address. The respectively addressed memory cell is incremented by one per symbol clock cycle, 
so that event counting takes place and a histogram is thus formed for each state. 

[0054] If N denotes the number of events per state zW and it is assumed that Hf/P), y <i>)=H(i,j) is the content of the 
memory cell of state z(i) and quantized valuer then: 

Equation 5 

Plr B \ zj - lim(l/N H(i,j)),, as N tends to infinity. 



[0055] This means that, provided N is sufficiently large, the event counting carried out results virtually directly in the 
30 conditional likelihood, which is found once again in the expression in the branch metrics for the optimum sequence 
estimator. 

[0056] In order to prevent memory overflows, the memory may be normalized at regular intervals (algorithm, page 5). 
Branch metrics calculation (BMC) 

35 

[0057] The branch metrics are calculated in the block BMC from the histogram H(ij). To do this, logarithms are taken 
of the individual memory contents H(i,j) in the event store 15: 



40 Equation 6 

BM(i,j) = -ln(H(i,j)) 

[0058] The elements of the metrics Table 1 4 obtained in this way are then, as is shown by way of example in Figure 
45 5, transferred by the discrete channel estimator 13 to the metrics Table 14. 

[0059] However, it should be remembered that the number of events per state 20) and quantized value r !) > may be 
very small or zero. For this reason, adaptation algorithms which are known to persons skilled in the art are used to 
prevent poles from occurring while taking logarithms. 

[0060] It is furthermore within the scope of the invention to transmit pilot data or test data first of all before signal 
so transmission starts, which data are distributed statistically or randomly over the various channel states by means of a 
scrambler or other suitable devices, and to offer the capability to set the estimation apparatus optimally during a test 
period for it. Such pilot data or test data can, furthermore, be transmitted regularly or as a function of any interference 
that occurs. 

55 

Claims 

1. Estimation apparatus in particular having a channel estimator (13) for estimating characteristics of a transmission 
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channel, in which case the transmission channel is subject to interference, and in which the analogue data (5) 
received from the transmission channel is assigned an estimator sequence (a) of digital data values in particular 
by means of a data estimator (11), 
which is characterized 

5 in that the estimator apparatus produces at least one estimation sequence (a) whose estimation includes both 

characteristics of the transmission channel and characteristics of the receiver. 

2. Estimation apparatus according to Claim 1, in which the analogue input signal (5) is preferably filtered and is 
analogue/digital converted as a preferably filtered signal r, and the analogue/digital converted value ? is assigned 

10 a value (l,j) from a metrics table (14). 

3. Estimation apparatus according to Claim 2, in which the values in an event table (15) each comprise the number 
of occurrences of a specific analogue/digital converted value in a state (z^) of the transmission channel. 

*5 4. Estimation apparatus according to Claim 3, in which the state per analogue converted value is obtained from the 
estimation sequence a of the data estimation apparatus (11). 

5. Estimation apparatus according to Claim 4, in which the conditional likelihood P(r u ilz^) of the occurrence of the 
analogue/digital converted value * » f or a state of the transmission channel Is obtained from the event table (15). 

20 

6. Estimation apparatus according to Claim 5, in which one element in the metrics table (14) corresponds to the 
logarithm of the conditional likelihood P( r^\z^ of the occurrence of a specific analogue/digital converted value ? p 
in state z^ of the transmission channel. 

25 7. Estimation apparatus according to one of Claims 2 to 5 r in which the conditional likelihood P(r u lz^ of occurrence 
of a specific analogue/digital converted value r p in a state of the transmission channel after completion of a meas- 
urement interval is normalized by forming the ratio with the total number of events N which have occurred for this 
state. 

30 8. Estimation apparatus according to one of Claims 2 to 7, in which the elements of the metrics table (14) are updated 
on the basis of the estimation sequences (a) obtained and the analogue/digital converted values. 

9. Estimation apparatus according to one of Claims 2 to 8, in which the data estimator (11) is supplied with the 
associated value set l a j from the metrics table (14), and which in each case assigns a most likely value of an 

35 estimation sequence (a) to the supplied value set l } j and supplies an output signal to the discrete channel estimator 

(13) , from which the channel estimator (13) determines the state of the transmission channel z^. 

10. Estimation apparatus according to Claim 9, in which histogram values are obtained from the elements of the event 
table (15) and are used to carry out continuous calculation of the values of the metrics table (14). 

40 

11. Estimation apparatus according to one of the preceding claims 2 to 10, in which the values in the metrics table 

(14) are each associated with more than one digital/analogue converted value. 

12. Receiver for receiving data transmitted by means of a transmission channel, characterized by an estimation 
45 apparatus according to one of the preceding claims. 

13. Receiver according to Claim 12, further characterized by a filter 12 and a sampler 8. 

14. System for transmitting data characterized by a receiver according to Claim 12 and an estimation apparatus 
so according to one of the preceding claims 1 to 11 . 
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FIG. 6 
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